Two theorems that relate discrete stochastic processes to microscopic mechanics 
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Starting from a classical mechanics of a "colloid particle" and A*' "water molecules", we study 
effective stochastic dynamics of the particle which jumps between deep potential wells. We prove 
that the effective transition probability satisfies (local) detailed balance condition. This enables 
us to rigorously determine precise form of the transition probability when barrier potentials have 
certain regularity and symmetry. 



PACS numbers: 02.50.Ey,05.40.-a,05.40.-a,05.20.-y 

Construction of statistical mechanics that applies to 
systems far from equilibrium is a major challenge in the- 
oretical physics (see [l| and references therein). It is 
expected that simple stochastic processes with discrete 
state spaces may be studied to elucidate various nonequi- 
librium phenomena and universal features of nonequi- 
librium states To define a physically meaningful 

stochastic processes, however, is not a straightforward 
task. 

There has been a consensus that the detailed balance 
condition is both necessary and sufficient for recovering 
physically realistic dynamics near and at equilibrium. 
But there has been no such guiding principles for dy- 
namics far from equilibrium. Moreover it was pointed out 
recently that the nature of steady states depend drasti- 
cally on the choice of stochastic dynamics in driven many- 
particle systems Q . With such a strong rule dependence 
one can hardly extract physically meaningful information 
from these stochastic models. It now seems necessary 
to reexamine what are "physically realistic" choices of 
stochastic dynamics. In doing that, one should avoid em- 
ploying any scheme (including Langevin equation) whose 
validity far from equilibrium has not been established. 

Here we present such a reexamination staring from 
microscopic mechanics. We consider, as probably the 
simplest nontrivial example, a classical mechanical sys- 
tem consisting of a "colloid particle" and N "water 
molecules". We assume that water is in thermal equi- 
librium while the particle is trapped in one of many deep 
potential wells. We focus on the effective stochastic dy- 
namics of the particle which jumps from a potential well 
to another. We first show that the transition probability 
satisfies the detailed balance condition. The result ex- 
tends to the situation where the particle (not molecules) 
is driven by an external field, thus establishing the lo- 
cal detailed balance condition [_2] . By using these general 
results, we can essentially determine the transition prob- 
ability when the potential barriers has certain regularity 
and symmetry. The resulting form (|16p . in which the 
barrier height determines the transition probability, has 
been well-known [^. Since this result applies to driven 
systems as well, it provides a starting point for reexamin- 
ing various features exhibited by nonequilibrium systems. 




B,^y Wy 



FIG. 1: A typical potential V'(R) and wells. Here the poten- 
tial at the barriers has regularity and symmetry stated below. 



Setting: We consider a system of a single "colloid par- 
ticle" (which we call a particle) and TV "water molecules" 
(which we call molecules) in a finite d-dimensional pe- 
riodic box A C K''. We denote by R e A and 
P G the coordinate and momentum, respectively, of 
the particle, and by e A and pi € R'^ the coordi- 
nate and momentum, respectively, of the i-th molecule 
where i = 1, 2, . . . , iV. We denote the state of the sys- 
tem collectively as F = (R, P; ri, . . . , tat; pi, . . . , pat), 
and the corresponding Lesbegue measure as dT = 
d'^Rd'^P n,=i d'^^i d'^'P^- The Hamiltonian is 

|p|2 N I |2 

^(r) = W + + E T^ + U{^; ri, . . . , tat), (1) 



where V{-) represents the external force acting on the 
particle, and [/(•) represents the interaction between 
the particle and molecules, the interaction between 
molecules, and the external force acting on molecules. 
We denote by 7^(-) the time evolution map of the Hamil- 
tonian dynamics determined by ([T|). 

Let A" be a finite set. With each x ^ X, we associate 
a region Wx C A so that Wx H Wy = whenever x ^ 
y. Each Wx corresponds to a potential well in which 
the particle may be trapped. We thus assume that the 
potential V{-) takes relatively small values inside each 
Wx, and becomes very large near and in boundary regions 
separating different wells (Fig.[T]). 

Suppose that molecules are in (near) equilibrium, and 
the particle is in a well Wx- After a certain amount of 
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time, which we call the relaxation time Trei, the system 
is expected to reach a quasi-equilibrium where the par- 
ticle is trapped within Wx- This state can naturally be 
modeled by the restricted canonical distribution 

PAr)-^xAr)e-^"^'\ (2) 

where 

11^ r, r 1, if R e 

Xa;((R,P;ri,...,rAr;pi,...,pjv)) = | ^ if R ^ 

'(3) 

is the characteristic function for the event that the par- 
ticle is in yVx- The restricted partition function is 

= / drx.(r)e-''^(n. (4) 

Detailed balance condition: Let us study the proba- 

(T) 

bility Pi^y that the particle moves from a well Wx to 
another well Wy after a fixed time T > 0. To do this, 
we sample initial condition according to let the whole 
system evolve for time interval T according to the Hamil- 
tonian dynamics, and then ask whether the particle is in 
Wy. The resulting probability is 

Pi% = J dTxyirTiT))PxiT). (5) 

Let r„ait be the typical waiting time that the parti- 
cle spends in a single well. By letting the potential at 
barriers high enough we can assume Tj-oi «C T^ait- Then 
by taking T which satisfies Ti-ei <?C T <^ T'wait, we can 
interpret Px-iy 1) as the transition probability from 
a quasi-equilibrium state where the particle is in Wx to 
another quasi-equilibrium state where it is in Wy. We 
thus end up with an effective Markov process (with dis- 
crete state space and discrete time) of the particle which 
jumps from a well to another according to the transition 
probability P^i'-ly P. 

Of course there is no hope of evaluating the transi- 
tion probability ([5]) exactly as it involves full Hamiltonian 
time evolution of the system with a huge number of de- 
grees of freedom. But, by a modification of the methods 
in 0, we can easily show the following symmetry. 

Theorem 1 — For any x,y € X and T > 0, one has 

ZxP^^jy^ZyP^^X (6) 

If we define the (restricted) free energy Fx by Zx = 
e~^^'', (O becomes 

p-l3F^p(T) _ l3Fyp{T) (r^-. 

^ x^y ^ ^ y^x^ \' J 

which is nothing but the detailed balance condition. 

Proof — Let us change the integration variable in 
according to F' = Tt{T). By using the Liouville theorem 



dT = dV and the energy conservation law H{T) = _ff (F'), 
([5]) becomes 

PFJy = ^J dr'xx{TMr'))xyir')e-^^(^'\ (8) 

We define the time reversal of a state F by F = 
(R, — P; ri, . . . , Tat; — pi, . . . , — pjv), where we have re- 
versed all the momenta. Note that for any F and x, we 
have Xx (F) — Xx (F) . By using the time reversal symme- 
try we see that 71t(F') — 7t(F'). By also noting that 
H(F') = H(F) and dV = dr, we have 

P^% -j-J dFx.(r^(F))x,(F)e-'5^(n 
= ^ / dFx,(F)x.(r^(r))e-'^^(n ^ l^pm^o) 

^x J ^x 

where we have renamed the variable F' as F to get the 
second line I 

Driven systems: It is crucial that we have derived the 
condition ([7]) without referring to the global equilibrium 
of the system. All we needed was the Hamiltonian me- 
chanics in which the particle moves relatively short dis- 
tance. This allows us to extend the result to driven sys- 
tems, which never settle to global equilibrium. 

We now assume that, in addition to the force described 
by the potential ^(R), a constant driving force E acts 
on the particle. The resulting mechanics cannot be de- 
scribed by a Hamiltonian mechanics (since we impose 
periodic boundary conditions), but by Newtonian equa- 
tions as 

rfR _dH dP _ dH dr, _ dH dp, _ dH 

H ^ 9P ' H ^ "9R^^' It ^ dpi' ~dt ~ "ar7' 

(10) 

for i = 1, . . . , TV. 

Our derivation of ([7]) is restricted to a Hamiltonian 
system, and does not apply to the Newtonian system 
([To)) as it is. We argue, however, that this Newtonian 
system can be replaced by a Hamiltonian system as long 
as the short-time behavior is concerned. 

Suppose that the system evolves according to (fTO|) 
starting from a distribution in which the particle is in 
Wx ■ There is a characteristic time Tpcr in which the par- 
ticle travels around the whole space and sees for the first 
time that A is periodic. Since T^cv grows indefinitely as 
the linear size of the system increases, we can safely as- 
sume that T ^ Tpor . Then we take a smaller box A C A 
which includes Wx and is large enough for the particle 
to remain always in A during the time interval T . We 
define the new Hamiltonian [8| 

He = H - E(R) • R. (11) 

where E(R) = E if R e A and E(R) = otherwise. 
As long as the particle stays within A, the equation of 
motion determined by pT|) is exactly the same as (flUl) . 
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FIG. 2: Arrangement of tlie wells and barriers in two dimen- 
sions. 



We can then define the quasi-equilibrium distribution 
(12) using the new Hamiltonian ([TTjl . Since the distribu- 
tion ^ and the partition function ^ only involves R in 
Wx C A, the sharp cutoff at the boundary of A in (fTT|) 
does not affect © or Note that the restricted parti- 
tion function Zx (and hence the restricted free energy 
Fx ) may depend on the choice of A, but the difference 



(E) 



Fy has a definite value when the wells Wx and 



vo{Ri,R2, • ■ ■ , Rd) = vo{-Ri,R2, • ■ ■ , Rd)- This means 
that the barrier looks identical from both the sides. For 
each x,y Cz X such that |x — y| = 1, there is a map 
fx.y '■ ^x,y ~^ B which consists of a translation and (if 
necessary) a rotation. 

We state our assumption on the potential V{-). If R G 
Wx for some x, then F(R) is completely arbitrary. If R G 
Bx,y for some x,y € X, then we set 1^(R) = vo{fx,y{Il)) + 
bx.y, where bx^y > is an arbitrary (large) constant which 
characterizes the height of the barrier at Bx,y If R ^ Wx 
and R ^ Bx.y for any x,y, then we set T^(R) = oo. 
The potential U{Il; ri, . . . , rAf) is assumed to be invariant 
under any translation by a lattice vector x d X. 

We first consider Hamiltonian time evolution with the 
Hamiltonian ([T]). It is possible to determine the transi- 

(T) 

tion probability Px-iy in the present rather general set- 
ting provided that T ^ Twait- 

Theorem 2 — For any e with < e < 1, there exists (a 
sufficiently small) T > such that 



Wy are close to each other. We can then repeat the same 
argument as before to derive 



< 



d(T) 
x^y 



(12) 



< 1 



(15) 



which is known as the local detailed balance condition, 
and has been used as a fundamental requirement in de- 
signing stochastic processes of driven systems [2] . 

Determination of the transition probability: In order 
to proceed further and determine the transition proba- 
bility P^^ y , we need to assume that potential at barriers 
between the wells are identical in their shapes (but not 
necessarily in their heights) and that each barrier poten- 
tial looks identical from both the sides. The potential 
within the wells is completely arbitrary. 

For simplicity we restrict ourselves to the simplest 
geometry depicted in Figs. [1] and [21 Let X — 
{1,2,..., L}'' C A be the unit lattice. We fix a constant 
< S < 1. For each x ^ X, we define the corresponding 



holds for any x,y ^ X with \x — y\ — 1, where p{T) > 
is independent of x,y. 

The theorem determines the transition probability as 



P^T}y^p{T)e- 



(16) 



well as a c?-dimensional cube Wx = {R | \Rj 



<(1 



This form has been known for quite a long time [J|, but 
we stress that here a neat and completely rigorous jus- 
tification is given The physics behind ^6]) is clear; 
the transition is mainly ruled by the process in which 
the particle thermally obtains (free) energy bx,y — Fx to 
overcome the barrier at Bx,y 

Proof — Consider a time evolution starting from an ini- 
tial state r distributed according to the quasi equilibrium 
distribution Px(r) in ^ for some x e X. For T > and 

~ (T) 

y & X such that — i/| = 1, let Px^y be the probability 
that the particle moves to Wy directly from Wx within 
time T. More precisely Px'^y is the probability that there 
are ti, t2, and t^ with < ti < t2 < ts < T such that 
r(t) G Wx for t G [0,ti), r(t) G Bx,y for t G [ti,t2], and 
r(t) G Wy for t G (i2,t3), where T{t) ^ Tt{T) denotes 
the state at time t. 

When T is sufficiently small compared with Twait, one 
can assume that (with a probability very close to one) 
the particle executes at most a single jump from Wx to 
a neighboring well within the time interval T. Then the 
To specify the barrier potential, we define the prototype newly defined probability Px-Iy should be identical to 



S)/2 for j = 1, . . . , d}, where we wrote R — (i?i, . . . , Rd) 
and X = (xi, . . . , Xd). For each pair x,y € X such that 
— 2/1 = 1, we define the boundary region Bx^y = By^x as 
follows. Let ej be the unit vector in the j-th direction. 
Then for any x £ X and j = 1 , . . . , d, we set 

Bx,x+., = {R\\R,-(x, + ^)\<^, 

\Rk-Xk\ < forfc/ j}.(13) 



B = {R I |i?i|<^,|i?,|<i^ forfeit}, (14) 

of the boundary region, and let wo(R) > be an ar- 
bitrary potential on B with the reflection symmetry 



piT) 



We therefore see that for any e > there is T 
such that 



£ Px-^y ^ 1 , £ 

5 - p(^) - ^ 5 



(17) 
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for any x,y G B with |x — = 1. Then, since 
(Z, Bi'^y)/{Zy P^^l) = 1 from dS]), we get 



l-e/5 ^ 
l + e/5 



(T) 



< 



y y — 



< 



l + g/5 
l-e/5' 



(18) 



Now, fLx x,y £ B with |a; — y| = 1. We introduce a 
modified model obtained by replacing T^(R) for R G Wj, 
by a constant V^(R) = b^.y — Vq, and letting by_z = oo for 
all z neighboring to y except z = x. Note that the prob- 
ability Px'^y does not change by this replacement since 

~ (T) 

Px-ly is fully determined by the dynamics of the particle 
within Wx and Bx,y On the other hand the probabil- 
ity Py^x becomes very simple since the potential within 
Wj, is constant and the only allowed jump is that to Wx- 

We can write P!y^x = Po{T) and Zy = Zq e-f^ -^<>\ 
where po{T) and Zq are independent of x, y. By denoting 
Pq{T) =po{T)Zoe'^^°, mi) becomes 



l-e/5 



< 



7 pC^) 

^ X — >y 



< 



l + e/5 



l + e/5 - po{T) e-P'^-^y " l-e/5 ' 
Using (|17p once agin, we get the bounds 



(19) 



< 



p{T) 
J^x^y 



<<i±£Z5)!. ,20) 



l + e/5 - po(T)e-/3(''-.«--F-) - l-e/5 ' 

which implies the desired (fT5|) if one notes < e < 1. I 

Driven systems: The proof of (|15p again extends to a 
driven system with the non-Hamiltonian time evolution 
pop since we can always study equivalent Hamiltonian 
system with the Hamiltonian pT|) . One must note, how- 
ever, that the assumed symmetry of the barrier potential 
is usually destroyed by the applied field. 

Simple examples where the symmetry survives are 
those with 5 = 0, i.e., the models with infinitesimally 
thin barriers. In this case we can prove the same esti- 
mate (|T5l) (with the prefactor p{T) possibly being direc- 
tion dependent). 

Usually it is not an easy task to compute the restricted 
free energy Fx since it involves interactions with mul- 
tiple molecules. The calculation becomes easy if we as- 
sume that the interaction between the particles and the 
molecules are so small that the partition function almost 
factorizes. We further take the simplest Gaussian po- 
tential V{R) = {ax/2) |r - a;^ + Cx for R e Wx and 
assume that there is an external field E = {E, 0, . . . , 0) 
with E ax for all x. Then the transition probabilities 
can be explicitly (and rigorously) computed as 



AT) 



p{T) exp[-/3(&,. 



xzkei 



Pi°)Ti?/2)], 



Pi^) ~p(T)exp[-/3(6.,,-Pi"))], 



(21) 



where y is any neighbor of x, not in the first direction. 



Here Fi 



(0) 



is the restricted free energy of the system without an ex- 
ternal field. The prefactors p{T), p{T) depend on details 
of the barrier potential. 



We stress that (|2T|) is the "physically correct" form 
of the transition probability in a model of a particle (or 
of particles) trapped in potential wells and driven by an 
external field. Indeed (pij) has been regarded as a re- 
alistic transition probability in ionic conductors, which 
the driven lattice gas is supposed to model. Given the 
strong rule dependence it seems important to study 
discrete models for nonequilibrium steady states by using 
the "correct" rule (EH). 
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We here do not attempt to justify the existence of the 
effective Markov process (although, physically speaking, 
it is obvious that there is a well defined Markov process 
if Trei <S T <C Twait). In fact the nature of the effective 
process depends crucially on details of the model, and such 
a justification is possible only when one makes various 
concrete (and sometimes technical) assumptions about the 
potential and the interaction. Interestingly all the results 
in the present paper hold rigorously, independently to the 
existence of an effective Markov process. Indeed all the 
results are true (but just meaningless) for a model with 
U{-) = 0, which is nothing but a deterministic mechanics 
(with a stochastic initial condition) of a single particle. 
It is obvious that the present theorem and proof extend to 
much more general situations. What one needs are disjoint 
subsets T>i, . . . , T>„ of the whole phase space, where the 
system has to overcome a high energy barrier to get out of 
each 7?i. Then for a given Hamiltonian H, we define the 
initial quasi-equilibrium distribution by generalizing ([2]) 



[9] 



{3/(2/3)} log(Ma,) + (3//3) log(/3/2^) 



as Pi(r) = (Z,)"^x[r G T^i] e-'^"'-^'. The transition prob- 
ability (O is also generalized as P^'^^- = / drx[7r(r) £ 
Vj]Pi{T). Then one can repeat the same argument to 
prove the detailed balance condition. In this manner, we 
can treat essentially any many-body systems. 
If necessary we use periodic boundary conditions to rede- 
fine R so that it has no jumps within A. 
We note that this is the leading behavior in the Krammers' 
formula. It seems very difficult to get rigorous estimates 
corresponding to the subleading behavior. 



